Audio equipment testing is done to provide consumers with an idea of what they are looking for and to make the process of equipment selection easier. The results are published in specialty electronics magazines, online, and in other media. Many people involved in the development or use of audio gear have an engineering background and attempt to bring a scientific perspective to evaluating audio gear. They are concerned with measurements using test equipment and would ideally like to see double-blind testing used to compare competing products. On the other hand, some reviewers believe that not all of the characteristics that produce excellence in sound reproduction are measured by the current tests. Audio reviewers in this camp also claim that double-blind testing does not provide the kind of relaxed extended-listening environment needed to evaluate an audio component. The testing methods used to evaluate equipment can be roughly divided into two groups. The two opposing factions are called objectivists, who believe that all perceivable differences in audio equipment can be measured scientifically and subjectivists, who believe that the human ear is capable of hearing details and differences that cannot be directly measured.[1] . Summary of Objective versus Subjective Audiophiles, in general: (1) Both Agree that measurements are not a substitute for listening (2) Both agree all loudspeakers and rooms have different sound qualities (3) Disagree that all electronics and wires have different sound qualities (4) Disagree that knowing the brand names could bias an audition (5) Disagree that two components playing music at slightly different volumes could be misinterpreted as "sound quality" differences Any sentences that follow this summary, and contradict it, are incorrect.
Contents |
Objectivists believe that audio components, accessories, and treatments must pass rigorously-conducted double-blind tests and meet specified performance requirements to meet the claims made by their adherents.
British audio equipment designer Peter Baxandall, who may be considered an objectivist, has written, "I ... confidently maintain that all first-class, competently designed amplifiers, tested under completely fair and carefully controlled conditions, including the avoidance of overloading, sound absolutely indistinguishable on normal programme material no matter how refined the listening tests, or the listeners, may be; and that when an inferior amplifier is compared with a very good one and a subjective quality difference is genuinely and reliably established, it is always possible, by straightforward scientific investigation, to find a rational explanation for this difference." Baxandall also proposed a "cancellation test", which he claimed would prove his point.[6]
One statement that has influenced some audiophiles' values is from Harry Pearson, long-time editor of The Absolute Sound:[7]
"We believe that the sound of music, unamplified, occurring in a real space is a philosophic absolute against which we may judge the performance of devices designed to reproduce music."
Some audiophile-equipment designers and consumers are obsessed over seemingly irrelevant details. Many components, for instance, are able to reproduce frequencies higher than the limit of human hearing—20 kHz.[9] Some sources, such as FM radio, will not reproduce frequencies higher than 15 or 16 kHz.
Subjectivists claim that experienced listeners can be relied upon for valid advice on how equipment sounds. British Hi-fi critic, Martin Colloms, writes that "the ability to assess sound quality is not a gift, nor is it the feature of a hyperactive imagination; it is simply a learned skill", which can be acquired by example, education and practice[10]. In any event, the eventual purchase decision will be made by the end-user, whose "perception is reality" and can be influenced by factors other than the equipment's actual performance.
Objectivists attack vacuum-tube amplifiers as vastly inferior because, in addition to their substantially higher total harmonic distortion, they require rebiasing, are less reliable, generate more heat, are less powerful, and are usually more expensive. [3] Subjectivists believe that while tubed electronics are less linear than solid-state electronics at high-signal levels, they are much more linear at low-signal levels — less than one watt. Many musical signals spend most of the time at these low levels.
Objectivists claim that digital sound is superior to analog sound because it has no clicks, pops, wow, flutter, audio feedback, or rumble, has a higher signal-to-noise ratio, has a wider dynamic range, has less total harmonic distortion, and has a flatter and more extended frequency response. [4] [5] Subjectivists however claim that the process of converting a bit-stream to an analog waveform requires heavy filtering to remove spurious high-frequency information and that it should be expected that such filtering should involve some signal degradation and a large amount of phase shift in the passband. They point out that commonly-used consumer-grade digital-to-analog converters (DACs) exhibit very poor linearity at low levels. Both problems, at first dismissed, were then addressed by such solutions as digital filtering, oversampling, and the use of DACs operating at 20-bit (or higher) resolution. Musician Neil Young, for example, is a harsh critic of the sound of the original CD format but has approved of the sound of the newer SACD format with its greater safety margin between its ideal behavior and the requirements set by the limits of human hearing.
Objectivists consider total harmonic distortion to be an accurate measure of sound quality. Subjectivist however claim that total harmonic distortion has been proven by scientific testing to correlate poorly with perceived sound quality. The type of distortion is more significant. For instance, distortion by even harmonics has been shown to be less objectionable than distortion by odd harmonics.
Subjectivists believe that sound quality is degraded by large levels of negative feedback in amplifiers. Objectivists claim that negative feedback is beneficial to amplifier stability and produced good test results using steady-state waveforms. Subjectivists however believe that the application of negative feedback is inherently problematic for constantly-changing waveforms such as those that occur in music.
Subjectivists claim that there is a limit to what can be tested using Objective measurements. High-end audio companies which do rely on quantitative evaluations guard their measurement techniques as trade secrets. These are far more complex than the techniques which are in the public domain e.g. total harmonic distortion, transient intermodulation distortion. Subjectivist point out that objectivists since the 1970s no longer tout distortion measurements in their advertisements as there is a general consensus that an amplifier with 0.01% total harmonic distortion may not sound "better" than one with 0.1% total harmonic distortion - especially if the lower distortion is achieved with (excessive) feedback.
Overall, the subjectivists' world is looked upon by objectivists as being a hotbed of gullibility and fraud, its marketing engine driven primarily by either a constant desire for one-upmanship or a more benign desire to tinker with equipment. In particular, the tinkering drive is fed by wild claims for minor parts of the system such as cables. Objectivists, however, are often harshly dismissed by subjectivists as meter men — people who simply refuse to recognize what the subjectivists consider obvious. The debate is rather heated in certain quarters, and even James Randi chimed in on the issue. [6]
It is difficult, but very important, to match sound levels before comparing systems, as minute increases in loudness—more than 0.15 dB[11] or 0.1 dB[12]—have been demonstrated to cause perceived improvements in sound quality.
Listening tests are subjected to many variables, and results are notoriously unreliable. Thomas Edison, for example, showed that large audiences responded favorably when presented both live performances by artists and reproductions by his recording system,[13] which today would be regarded as primitive in quality.
Similarly, results of component evaluation between various listeners or even the same listener under different circumstances cannot be easily replicated or standardized.
Similarly, the acoustic behavior of the listening room—the interaction between loudspeakers and the room's acoustics—and the interaction between an electromechanical device (loudspeaker) and an electronic device (amplifier) are subjected to many more variables than between electronic components. Thus the "difference" in sound quality between amplifiers is actually the ability of an amplifier to interface well with loudspeakers or a lucky combination of loudspeaker, amplifier, and room that works well together[14].
The introduction of switching apparatus, with either metal connection (mechanical switches) or electronic processing (solid-state switches), may, some believe, obscure the differences between the two signal sources being tested.